NORMES 


1 


Representations of Teacher Quality, Quantity, and Diversity in 
a National Mathematics and Science Program 

Patricia S. Moyer-Packenham, Johnna J. Bolyard, and Hana Oh 
George Mason University 

Patricia Kridler 
Auburn Middle School 

Gwenanne Salkind 
Fairfax County Public Schools 

Abstract 

Growing awareness of the importance of teacher quality in mathematics and 
science has stimulated a variety of national reports and funded initiatives for 
the purpose of improving teaching and learning in K-12 schools. This study 
examined the work of awardees in one federally-funded program that included 
a focus on increasing the number, quality, and diversity of mathematics 
and science teachers. Secondary data sources were used to understand 
representations of mathematics and science teacher quality, quantity, and 
diversity reported by awardees, and to identify interventions awardees 
implemented to influence teacher quality, quantity, and diversity. Results 
indicated a primary focus on the development of teacher characteristics such 
as subject knowledge, pedagogical knowledge, and instructional practices. 
Seven common interventions were implemented across the program to influence 
the quality of individual teachers and the quantity and diversity of the teacher 
population. Three prevalent themes in the secondary documents included: a) 
awardees ’ knowledge of and implementation of research-based professional 
development practices; b) a shift in emphasis to include specialized subject 
knowledge preparation for elementary teachers, in addition to the traditional 
emphasis on subject knowledge for middle and high school teachers; and c) 
involvement of STEM faculty and Teacher Leaders in various collaborative 
relationships, in activities at all levels (K-12) and in both mathematics and 
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science. Intervention efforts to influence teacher quantity and diversity were 
in their initial stages and limited in scope. These findings are discussed with 
reference to the impact of the program on the quality, quantity, and diversity 
of mathematics and science teachers. 

Introduction 

Teacher quality in mathematics and science has a significant impact on 
the teaching and learning process (Ferrini-Mundy & Schmidt, 2005; Hiebert 
et al., 2003; Lindquist, 2001; Silver & Kenney, 2000). As policy, such as the 
No Child Left Behind Act of 2001 (NCLB, 2002) and research, including 
the TIMSS international comparisons of student performance (Hiebert et al., 
2003), converge around mathematics and science issues, it is clear that the 
importance of teacher quality in these content-specific areas is of national 
significance. Although the quality of mathematics and science teachers has 
gained national prominence in policy statements and educational reform efforts 
(Conference Board of the Mathematical Sciences, 2001 ; Council of Scientific 
Society Presidents, 2004; National Council of Teachers of Mathematics, 
1991, 2005; National Research Council, 1996; National Science Teachers 
Association’s, 2002, 2004), understanding the meaning of teacher quality is 
a complex issue. 

Teacher quality includes not only the characteristics of individual 
teachers, but also the characteristics of the teacher population as a whole. When 
we refer to improving a teacher’s subject- specific knowledge in a discipline 
such as mathematics or science, we are referring to the quality of individual 
teachers. When we refer to the examination of teacher turnover or teacher 
shortages in subject- specific areas or to the importance of a diverse teaching 
force, we are referring to the quality of the teacher population. Teacher quality, 
then, is a complex construct encompassing an array of different characteristics 
that are not easily defined, assessed, categorized, or measured. 

In July 1999, U.S. Secretary of Education Richard Riley announced 
the appointment of the National Commission on Mathematics and Science 
Teaching for the 2L^ Century (the Glenn Commission) to investigate the 
quality of mathematics and science teaching and examine ways to increase the 
number and quality of mathematics and science teachers in K-12 schools. The 
resulting report. Before It’s Too Late (National Commission on Mathematics 
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and Science Teaching for the 2P^ Century, 2000), highlighted the importance 
of quality education in mathematics and science to prepare students to be 
competitive in an increasingly global society. This focus on teacher quality in 
mathematics and science has resulted in several national initiatives funded by 
the federal government, under the direction of agencies such as the National 
Science Foundation (NSF) and the Department of Education, to initiate Math 
and Science Partnership Programs for the purpose of improving mathematics 
and science teaching and learning in K-12 schools. The goals of the NSFs 
Math and Science Partnership (MSP) Program are stated as follows: 

MSP serves students and educators by emphasizing strong 
partnerships that tackle local needs and build grassroots support 
to: 

• Enhance schools’ capacity to provide challenging curricula for 
all students and encourage more students to succeed in advanced 
courses in mathematics and the sciences; 

• Increase the number, quality and diversity of mathematics and 
science teachers, especially in underserved areas; 

• Engage and support scientists, mathematicians, and engineers 
at local universities and local industries to work with K-12 
educators and students; 

• Contribute to a greater understanding of how students effectively 
learn mathematics and science and how teacher preparation and 
professional development can be improved; and 

• Promote institutional and organizational change in education systems 
— from kindergarten through graduate school — to sustain partnerships’ 
promising practices and policies (National Science Foundation, 
2007). 

The present study was designed to examine more closely the 
implementation of one of these goals; namely, the way in which awardees in 
the MSP Program “increase the number, quality and diversity of mathematics 
and science teachers. . .” (item #2). Our investigation focused on three major 
constructs: the quality of individual mathematics and science teachers, the 
quantity of mathematics and science teachers in the teacher population, and 
the diversity of mathematics and science teachers in the teacher population; 
and examined these constructs along two dimensions: representations 
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and interventions. In the seetions that follow we review the literature on 
teaeher quality, quantity, and diversity; present findings based on seeondary 
souree doeuments provided by MSP Program awardees that illuminate their 
representations of teaeher quality, quantity, and diversity within their work; and 
diseuss the interventions identified by awardees to influenee quality, quantity, 
and diversity speeifieally for mathematies and seienee teaehers. These findings 
lead to a diseussion of the implieations of awardees’ work on teaeher quality, 
quantity, and diversity for mathematies and seienee edueation. 

Research on Teacher Quality, Quantity, and Diversity 

To establish a baekground against whieh to examine representations 
of teaeher quality, we used Bolyard and Moyer-Paekenham’s (in press) 
review identifying six eharaeteristies of mathematies and seienee teaehers 
eommonly examined for their relationship to student outeomes. These six 
eommonly used eharaeteristies ineluded: 1) general ability, 2) experienee, 3) 
pedagogieal knowledge, 4) subjeet knowledge, 5) eertifieation status, and 6) 
teaeher behaviors, praetiees, and beliefs. We also used eharaeteristies in the 
literature related to the teaeher population. These eharaeteristies ineluded: 
attrition, migration, and retention (for teaeher quantity) (Ingersoll, 2006a; 
Ingersoll, 2006b; Johnson, Berg, & Donaldson, 2005); and the demographie 
eomposition of the teaehing foree, the importanee of having a diverse teaehing 
foree, and methods and strategies for improving teaeher diversity (for teaeher 
diversity) (Clewell & Villegas, 1998; Dandy, 1998; Darling-Hammond, 
Dilworth, & Bullmaster, 1996; Holloway, 2002; Jorgenson, 2001; Loving & 
Marshall, 1997; Newby, Swift, & Newby, 2000; Shen, Wegenke, & Cooley, 
2003; Torres, Santos, Peek, & Cortes, 2004). Among these eharaeteristies are 
variables gathered through assessment measures (i.e., responses to test items 
or teaehing performanee during an observation) and nonassessment measures 
(i.e., highest degree obtained or number of years of teaehing experienee) 
(Ameriean Statistieal Assoeiation, 2007). 

Teacher Quality: Characteristics of Individual Mathematics and Science 
Teachers 

Subject knowledge is eonsidered by many to be an important eharaeteristie 
of mathematies and seienee teaehers. Researeh indieates links between teaehers’ 


Journal of Educational Research & Policy Studies 


5 

subject matter preparation and teacher effectiveness (Darling-Hammond, 
2000; Darling-Hammond & Youngs, 2002; Rice, 2003; Wilson & Floden, 
2003; Wilson, Floden, & Ferrini-Mundy, 2001), with the most consistent 
results showing positive links between teachers’ mathematics knowledge 
and secondary students’ mathematics achievement (Wilson & Floden, 2003). 
Goldhaber and Brewer (1997a; 1 997b) found that teachers holding bachelor’s 
or master’s degrees in mathematics had a statistically-significant positive 
relationship to high school students’ mathematics achievement (compared to 
teachers without advanced degrees or out-of-subject degrees). In science, they 
found holding a bachelor’s degree in science (rather than having no degree 
or a BA in another subject) to have a statistically positive relationship with 
student achievement (Goldhaber & Brewer, 1 997a). A later study found similar 
positive results for teachers having a mathematics BA or MA on secondary 
students’ mathematics achievement, but no significant relationship between 
a science degree and secondary students’ science achievement (Goldhaber 
& Brewer, 2000). Studies of the relationship between the number of courses 
taken in the subject and student achievement have found generally positive 
results for mathematics (Chaney, 1995; Monk, 1994). In science, results are 
generally positive but depend upon the area of science studied (e.g., physical, 
earth, or life sciences) (Chaney, 1995; Druva & Anderson, 1983; Monk & 
King, 1994). 

Studies of mathematics and science pedagogical knowledge 

have reported positive effects of education training on teachers’ knowledge 
and practices (for example, see Adams & Krockover, 1997; Gess-Newsome & 
Lederman, 1993; Valli&Agostinelli, 1993). Studies examining the relationship 
between degrees in education as a measure of teachers’ pedagogical knowledge 
and student outcomes have been mixed. At the secondary level, studies indicate 
that coursework taken in subject-specific pedagogy is positively related to 
secondary students’ achievement, particularly in mathematics (Chaney, 1995; 
Monk, 1994). Wilson and Floden (2003) note that much of the research focuses 
on teacher education programs rather than specific courses or experiences. 

Research also examines the relationship between teachers ’ behaviors, 
practices, and beliefs and student outcomes. Peterson, Fennema, Carpenter, 
and Loef (1989) found a significant relationship between first-grade teachers’ 
pedagogical content beliefs about addition and subtraction and student 
achievement. In science, the use of hands-on laboratories (Burkam, Lee, & 
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Smerdon, 1 997) and inquiry-based teaching practices (Von Seeker, 2002) were 
significantly related to secondary students’ science achievement. Other studies 
show associations between characteristics of high school science teachers 
and better classroom discipline (Druva & Anderson; 1983), and kindergarten 
teachers’ instructional practices and student gains in mathematics (Guarino, 
Hamilton, Lockwood, & Rathbun, 2006). 

Mathematics and science teachers’ certification status is frequently used 
as a measure of the effects of knowledge gained from teacher preparation 
(Darling-Hammond, Berry, & Thoreson, 2001). Researchers compare 
those who are fully certified and those who hold provisional or emergency 
certification (Evertson, Hawley, & Zlotnik, 1985; Fetler, 1999; Goe, 2002; 
Goldhaber & Brewer, 2000). Several studies indicate an advantage in favor 
of fully certified teachers on measures of student achievement and teacher 
performance evaluations (Darling-Hammond, 2000; Evertson, Hawley, & 
Zlotnik, 1985; Fetler, 1999). Mathematics student achievement has also been 
found to be positively associated with having a teacher who is certified in-field 
(Hawk, Coble, & Swanson, 1985; Goldhaber & Brewer, 1997a, 1997b). Several 
studies show no significant differences or mixed results when comparing the 
teaching performances of regularly versus alternatively certified teachers 
on subject area and professional knowledge tests (Hawk & Schmidt, 1989), 
performance ratings (Hawk & Schmidt, 1989; Eutz & Hutton, 1989; Sandlin, 
Young, & Karge, 1992), teaching concerns surveys (Houston, Marshall, & 
McDavid, 1993; Sandlin et al., 1992), and teacher observations and student 
achievement (Miller, McKenna, & McKenna, 1998). 

Researchers frequently investigate years of teaching experience 
as a teacher quality characteristic with several studies reporting positive 
relationships between teachers’ years of experience and effectiveness 
(Ehrenberg & Brewer, 1995; Ferguson, 1991; Fetler, 1999; Goldhaber & 
Brewer, 1997b; Greenwald, Hedges, & Eaine, 1996; Hanushek, 1992, 1996; 
Mumane & Phillips, 1981). Hawkins, Stancavage, and Dossey (1998) found 
statistically-significant associations between teacher experience and 4^^^- and 
8th-grade students’ mathematics achievement. Rivkin, Hanushek, and Kain 
(2005) found students of beginning teachers performing significantly worse 
than those of experienced teachers in mathematics. In science, Druva and 
Anderson’s (1983) meta-analysis of 65 studies found student outcomes in 
science positively related to teachers’ experience. However the relationship 
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was not particularly strong. Other studies examining the relationship between 
teaeher experienee and student aehievement have reported mixed or no results 
(Ferguson & Ladd, 1996; Hill, Rowan, & Ball, 2005; Rowan, Correnti, & 
Miller, 2002). 

General ability refers to teaehers’ general intelleetual aeademie and 
verbal abilities, often ineluding evidenee of language and mathematieal 
profieieney. Studies generally report a positive relationship between measures 
of teaehers’ general and verbal abilities and their effeetiveness (Ehrenberg & 
Brewer, 1994; Ferguson, 1991; Ferguson & Ladd 1996; Greenwald, Hedges, 
& Laine, 1996; Hanushek, 1971; Strauss & Sawyer 1986). Other studies 
indieate mixed or negative results (Ehrenberg & Brewer, 1995; Guyton & 
Farokhi, 1987; Hanushek, 1992; Mumane & Phillips, 1981). 

Teacher Quantity: Turnover and Retention of Mathematics and Science 
Teachers 

The entry and exit of teaehers into and out of the profession has been 
eharaeterized as a “revolving door.” Ingersoll (2001) argues that this situation 
is not a result of shortages of teaehers or teaeher retirements, but rather teacher 
turnover, defined as departure of teaehers from their teaehing jobs. Statisties 
indieate that the eurrent teaehing foree will lose almost half of its professionals 
in the next few years and one in five new teaehers will not remain in teaehing 
long enough to reaeh their fourth year (Johnson & Birkeland, 2003). 

Two important elements of teaeher turnover are teacher attrition (leaving 
the profession) and teacher migration (moving from one sehool to another) 
(Johnson et al., 2005). When sehools report a shortage of mathematies and 
seienee teaehers, they are often referring to both of these elements. Over time, 
researeh has shown that about 1 5 pereent of Ameriea’s 3 million teaehers 
leave their sehools or leave teaehing eaeh year, and after 5 years, 46 pereent 
of teaehers leave the teaehing profession (Ingersoll, 2006a; 2006b). These 
numbers are even more startling for new teaehers, who leave at a rate of almost 
50 pereent after four years, and for teaehers in small, urban, poor sehools, 
where the turnover rates are 26 pereent eaeh year. 

Sehools searehing for mathematies and seienee teaehers already 
know how diffieult it is to find replaeements with annual turnover rates 
for mathematies and seienee teaehers at about 16 pereent and 15 pereent 
respeetively, eompared to 9 pereent for soeial studies and 12 pereent for 
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English (Ingersoll, 2006b). A closer examination of turnover for mathematies 
and seienee teaehers shows that reasons for leaving teaehing inelude pursuing 
other jobs (28%) and retiring (11%). While 40 pereent of mathematies and 
seienee teaehers who leave do so beeause of dissatisfaetion, only 29 pereent 
of ah teaehers in the general population report leaving teaehing beeause of 
dissatisfaetion. For mathematies and seienee teaehers, dissatisfaetion most 
frequently ineludes poor salary, poor administrative support, poor student 
motivation, and student diseipline problems (Ingersoll, 2006a). Reeruiting 
more and more teaehers will not address these problems. Sehools must design 
induetion and retention plans that take into aeeount sehool working eonditions 
if they want their mathematies and seienee teaehers to stay in teaehing. 

Researeh on teaeher induetion shows that when a first-year teaeher 
has a full induetion experienee (ineluding eohaboration with a mentor in the 
same subjeet field, teaeher networking and beginners seminars with other new 
teaehers, redueing new teaehers’ eourse preparations, providing a teaeher ’s 
aide, faee time with sehool administrators, regularly seheduled eommon 
planning and release time for the mentor and new teaeher to observe and 
analyze teaehing), there is a statistieally signifieant impaet on the retention 
of that teaeher (Smith & Ingersoll, 2004). Unfortunately only one pereent of 
new teaehers reeeive this type of eomprehensive support (Smith & Ingersoll, 
2004). 

High teaeher turnover in mathematies and seienee has many eosts. 
Researeh shows that teaeher turnover inereases the variation in student 
outeomes aeross grades and eohorts in a sehool, with differenees in 
mathematies aehievement signifieantly related to teaeher turnover (Rivkin 
et al., 2005). Unfortunately for students, the highest turnover rates are in the 
poorest sehools where mathematies and seienee teaehers are needed most 
(Neild, Useem, Travers, & Lesniek, 2003). There are also finaneial eosts to 
sehools in reeruiting, hiring, induetion, and professional development (Texas 
Center for Edueational Researeh, 2000). A 2000 study found that sehools in 
Texas spend over $329 million dollars eaeh year as a result of a 15.5 pereent 
teaeher turnover rate. Other estimates report that, aeross the Nation, $2.6 
billion is lost annually beeause of teaeher turnover (Ahianee for Exeellent 
Edueation, 2004). 
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Diversity of the Teaching Force 

The student population in Ameriea’s sehools is inereasing in diversity in 
terms of raee and ethnieity; however, the diversity of the teaeher population 
has not followed this trend (Dandy, 1998; Newby et ah, 2000; Shen et ah, 
2003; Torres et al, 2004). Data from a nationally representative sample of 
publie sehool teaehers indieates that sehools have made slight inereases in the 
raeial and ethnie diversity of the teaehing foree in the years between 1987- 
1988 and 1999-2000; however, during this time, the number of male teaehers 
deereased (Shen et al., 2003). Although there are inereases in the numbers of 
diverse teaehers in the new teaeher population, retention of new teaehers eould 
prevent these gains from impaeting the diversity of the teaehing population 
over time (Darling-Hammond et al., 1996; Kirby, Berends, & Naftel, 1999; 
Shen et al., 2003). 

Barriers to inereasing diversity in the teaehing foree inelude too few 
minority students prepared for post-seeondary edueation as a result of 
inadequate K-12 edueation, small numbers of minority students enrolling 
in teaeher edueation programs, and finaneial and eeonomie eonsiderations 
(Clewell & Villegas, 1 998). Another barrier eited is eompeteney testing (either 
as part of the requirements for a teaeher edueation program or for lieensure) 
for whieh researeh indieates higher failure rates for minority students than for 
White students (Darling-Hammond et al., 1996; Kirby et al., 1999; Latham, 
Gitomer, & Zimonek, 1999). While there is some evidenee to indieate that 
testing requirements negatively impaet the diversity of the teaehing foree, there 
is also evidenee that they are not the souree of the problem, as the majority 
(81%) of the overall population of teaeher eandidates taking the tests is white 
(Latham et al., 1999). 

The importance of a diverse teachingforce. The importanee of inereasing 
the diversity of the teaehing foree is deseribed as neeessary in order to reduee 
gaps in aehievement between white and nonwhite students (Darling-Hammond 
et al., 1996). Arguments foeus on the need and importanee of role models and 
teaehers who ean relate to students’ baekgrounds and experienees (Loving & 
Marshall, 1997; Riley, 1998). The pedagogieal benefits of a diverse teaehing 
foree inelude the advantages teaehers of eolor may have in sueeessfully 
building relationships and relating to students from minority groups by using 
their personal experienees to eonneet with learners (Clewell & Villegas, 
1998; Darling-Hammond et al., 1996). There are a limited number of large- 
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scale studies on the relationship between same-raee teaehers and minority 
(and general) student aehievement (Torres et ah, 2004). Results indieate 
mixed evidenee for a direet eorrelation between teaeher diversity and student 
aeademie performanee (Ehrenberg, Goldhaber, & Brewer, 1995). 

Strategies that impact teacher diversity. There are several reeommendations 
to improve minority teaeher reeruitment and retention. These inelude: 
improving the K-12 edueational experienees of minority students; early 
identifieation of potential future teaehers; reeruitment of teaeher edueation 
eandidates at the eommunity and junior eollege levels; implementation of 
programs that support minority teaeher eandidates throughout the edueation, 
initial eertifieation, and induetion proeesses (ineluding mentoring programs); 
reeruitment of eandidates from non-traditional populations (seeond-eareers 
or paraedueators); and reeruitment of eandidates from liberal arts majors 
and undergraduates having no deelared major (Clewell & Villegas, 1998; 
Darling-Hammond et al., 1996; Holloway, 2002; Jorgenson, 2001; Loving & 
Marshall, 1997; Newby et al., 2000). Early identifieation programs expose 
qualified high sehool or middle sehool students to teaehing through eadet or 
tutoring programs. These efforts raise awareness of and interest in teaehing 
as a profession and support and eneourage students to prepare for and enter 
the profession (Loving & Marshall, 1997; Newby et al., 2000). Programs 
designed to eneourage para-edueators to beeome teaehers have been found to 
play a role in diversifying the teaehing foree (Haselkom & Fideler, 1 996), and 
there is evidenee that these programs have higher retention rates than many 
traditional teaeher edueation programs (Dandy, 1998; Haselkom & Fideler, 
1996). 

Other studies indieate that alternative eertifieation programs may serve 
as a souree for reeruiting minority teaehers (Kirby et al., 1999; Shen, 1998). 
Findings of one study indieate that altematively-eertified teaehers are more 
likely to be female, be teaehing in elementary sehools, and express less desire 
to eontinue teaehing in the long term (Shen, 1 998). Therefore, while alternative 
eertifieation might eontribute to diversity in terms of raee and ethnieity, it 
does not in terms of gender (Shen, 1998). Shen (1998) further found that 
while alternatively eertified teaehers are more likely to teaeh mathematies 
and seienee, alternatively eertified minority teaehers are less likely to hold a 
baehelor’s in mathematies, seienee, or engineering than alternatively eertified 
white teaehers. 
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As our review of the researeh on teaeher quality, quantity, and diversity 
indieates, several eharaeteristies of individual teaehers and of the teaeher 
population are influential in the relationships between mathematies and seienee 
teaehers and the students they teaeh. The purpose of the present study was 
to examine data from the National Seienee Foundation’s Math and Seienee 
Partnership (NSF-MSP) Program in an effort to determine how awardees 
in the program represented eharaeteristies of teaeher quality, quantity, and 
diversity, and what interventions awardees implemented to influenee those 
eharaeteristies within their awards. The following researeh questions guided 
this analysis: a) What are representations of mathematies and seienee teaeher 
quality, quantity, and diversity among awardees in the MSP Program? and 
b) What interventions do awardees implement to influenee teaeher quality, 
quantity, and diversity eharaeteristies within their awards? 

Methods 

Data Sources 

The data sourees in this study eame from funded partnerships in the 
National Seienee Foundation’s Math and Seienee Partnership (NSF-MSP) 
Program awarded between FY2002 and FY2004. The NSF deseribes the 
following four eomponents of the MSP Program: 

• Comprehensive Partnerships implement ehange aeross the K-12 
eontinuum in mathematies, seienee, or both. 

• Targeted Partnerships foeus on improved student aehievement in a 
narrower grade range or diseiplinary foeus in mathematies and/or 
seienee. 

. Institute Partnerships develop mathematies and seienee teaehers as 
sehool- and distriet-based intelleetual leaders and master teaehers. 

. Researeh, Evaluation, and Teehnieal Assistanee (RETA) aetivities assist 
partnership awardees in the implementation and evaluation of their work 
(National Seienee Foundation, 2007). 

The present study examined data from 48 awards in three of these eategories, 
ineluding: 12 Comprehensive Partnerships, 28 Targeted Partnerships, and 8 
Institute Partnerships. RETA awards were not ineluded in the analysis due to 
the nature and seope of their work in “assisting” the other award eategories. 
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Each partnership was required to address the quality of the mathematies 
and seienee teaehing foree and to doeument its progress towards the teaeher 
quality goals and benehmarks it established. Awardees submitted Annual and 
Evaluation Reports deseribing this progress, and posted papers, presentations, 
and webpages in eleetronie media forms. These seeondary doeuments were 
the primary souree of data for the analysis. In the present analysis, researehers 
reviewed 132 Annual and Evaluation Reports provided to the NSF, with the 
length of eaeh report ranging from 15 to 707 pages. These reports, along with 
awardees websites, published papers, and presentations, were the seeondary 
souree doeuments for the analysis. Data reviewed for this paper were obtained 
from doeuments available to researehers between January 2005 and February 
2006. 

Procedures 

The examination was eondueted using qualitative methods for a doeument 
analysis of seeondary data sourees (Miles & Huberman, 1994; Patton, 1990) 
and was used to identify awardees’ narrative deseriptions of eharaeteristies 
and interventions influeneing mathematies and seienee teaeher quality, 
quantity, and diversity (Bogdan & Biklen, 1998). The methods of analysis 
employed both a eontent analysis, using a eategorieal system for organizing the 
information (Fraenkel & Wallen, 1993), and a eoneept analysis, to understand 
the meaning and usage of terms (MeMillan & Wergin, 2002). The unit of 
analysis was the individual award. Beeause of the eomplex nature of awardees’ 
reports, the researeh team used hand eoding (rather than eleetronie software) 
to better preserve the eontext and eontent of the information eontained in the 
reports. A team of six readers eondueted the analysis, and 30 pereent of the 
doeuments were read by two different readers to ensure reliability. Awardees’ 
reports to the NSF were available to researehers in an eleetronie format that 
was password proteeted. Projeet websites, publieations, and eonferenee papers 
were generally available through internet aeeess. 

Three-Phase Analysis 

Researehers analyzed data sourees in three phases. During the first phase, 
researehers identified broad themes to guide the initial reading of the reports, 
based on reviews of the literature. Additional themes and sub-themes emerged 
during the readings. During this phase, researehers read through reports in 
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their entirety and searehed awardees’ websites, publieations, and eonferenee 
presentations for supporting information. Readers used an analytie protoeol 
to eode information and write summaries. The protoeol ineluded a table for 
doeumenting the presenee of themes, a seetion for writing detailed summaries, 
and a referenee seetion to reeord page numbers and appendiees from whieh 
the information was extraeted so researehers eould return to the doeuments 
to review information in its original eontext. Researehers met weekly to eross 
eheek themes and eompare eoded eategories. 

There were several ehallenges in organizing the large volume of report 
data: some awardees ineluded extensive information about aetivities in 
eomparison with other awardees that ineluded little information; information 
was seattered in numerous plaees throughout reports, whieh required extensive 
reading to eonneet eommon themes; and, information was sometimes presented 
in a way that was unelear to a reader outside the award, using terms sueh as “the 
faeulty,” “the teaehers,” or “the sehool,” without speeifieally identifying the 
faeulty, teaehers, or sehool to whieh the deseription was referring. Researehers 
eross-refereneed different sourees to pieee together information. 

During the seeond phase of the analysis, two Ph.D. -level researehers 
read and eoded all of the written summaries, using open and axial eoding to 
examine themes and define eategories (Strauss & Corbin, 1998). The main 
purpose of axial eoding was to gain a better understanding of the eategories 
by identifying properties and dimensions around their “axis.” Researehers 
foeused on an individual theme, sueh as Teaeher Leadership, and read all of the 
written summaries on that theme using a eonstant eomparative method (Strauss, 
1987). During this proeess, researehers determined major eategories and sub- 
eategories, wrote deseriptions of the eategories, and extraeted examples from 
the reports. 

During the third phase of the analysis, researehers used the eategories in 
a key -word seareh proeess through the reports for the purpose of eategorieal 
aggregation (Stake, 1995). Using the seareh tool on Adobe Aerobat Reader, 
researehers used a variety of key words to eonduet exhaustive searehes for 
information on the properties of the eategories. By the end of the third phase, 
researehers ereated doeuments with lists of examples from awardees’ reports 
for eaeh eategory related to teaeher quality, quantity, and diversity, and 
eompiled a list of frequeneies aeross the 48 awards. 

In an effort to synthesize the narrative results for presentation, researehers 
developed a eategorieal organization framework for ease of eomparing the 
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prominence of major themes among the representations and interventions 
identified by awardees. This framework uses the following categories: 
Category 3 (C3) = representations and interventions discussed and identified 
by 70 - 100% of the 48 awardees; Category 2 (C2) = identified by 40 - 69% 
of the 48 awardees; Category 1 (Cl) = identified by 10 - 39% of the 48 
awardees; and Category 0 (CO) = identified by 0 - 9% of the 48 awardees. These 
categories were determined by grouping the frequencies of representations 
and interventions, and first removing the bottom 0 - 9% (or 0 to 4 awards) 
in each grouping. When occurrences were reported in 0 - 9% of the awards, 
these occurrences were determined to be a rare or unique activity among the 
awards in the program (CO). The next sets of occurrences were sectioned 
into thirds. In the lowest third of occurrences were those items that were 
reported in 10 - 39% of the awards (or 5 - 18 awards. Cl). In the middle third 
of occurrences were those items that were reported in 40 - 69% of the awards 
(or 19 - 33 awards, C2). In the top third of occurrences were those items that 
were reported most frequently across the awards in the program by 70 - 100% 
of awards (or 34 - 48 awards, C3). These categories were assigned to give 
the reader a sense of the portion of awards reporting each theme across the 
entire MSP Program. Throughout the results, this categorization is used to 
identify the most common representations and interventions of teacher quality, 
quantity, and diversity that are part of the work of the awardees in the MSP 
Program. 

Results 

Researchers identified a variety of major themes of teacher quality that 
centered on characteristics of individual teachers, characteristics of the teacher 
population, and interventions reported as influences on teacher characteristics. 
The framework in Figure 1 represents a general organization of these themes 
from the reports. All of the 48 awards provided descriptive information on 
increasing the quality of individual mathematics and science teachers and on 
increasing teacher quantity. Fewer awards provided descriptive information 
on increasing teacher diversity. 

The results are organized around two major themes that address 
our research questions: 1) what awardees identify as representations of 
mathematics and science teacher quality, quantity, and diversity, and 2) 
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interventions awardees implement to influenee teaeher eharaeteristies. The first 
seetion of the results reports representations of teaeher quality, quantity, and 
diversity identified by awardees. The seeond seetion diseusses interventions 
awardees implemented to influenee teaeher eharaeteristies. Examples from 
awardees’ doeuments are presented to provide a eontext for the themes. The 
eategories (i.e., C3, C2, Cl, and CO) shown in parentheses are used as a way 
to group and identify the frequeney of given representations and interventions. 
These themes, along with their examples, provide insights into the substanee 
of awardees’ work in the MSP Program. 


Figure 1 

Major Themes in Awardees ’ Documents 


Individual Characteristics 

Subject Knowledge 
Pedagogical Knowledge 
Behaviors/Practices/Beliefs 

REPRESENTATIONS 
of Teacher Quality 

PoDulation Characteristics 

Quantity (numbers of teachers) 
Diversity (race/ethnicity) 

t t 

t t 


INTERVENTIONS 

Influencing Teacher Quality Characteristics 

Inservice Training/Prof. Development Preservice Training 

Teacher Leadership 

Einking Teachers with STEM Eaculty 

Recruiting 

Stipends/Compensation 

Induction 



Representations 

Awardees deseribed various representations of teaeher quality, quantity, 
and diversity. Representations of the quality of individual teaehers frequently 
deseribed by awardees ineluded: subjeet knowledge, pedagogieal knowledge, 
and behaviors, praetiees, and beliefs. Representations of the quantity and 
diversity of teaehers ineluded: numbers of teaehers and raee/ethnieity, 
respeetively. These results are summarized in Table 1 . 
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Table 1 


Frequency of Representations Reported by Awardees that 
Characterize Teacher Quality, Quantity, and Diversity 


Constructs 

Representations 

Erequency 

Teacher Quality 


Subject Knowledge 

C3 


Test Scores 

C2 


Certification, Degrees, Courses 

C2 


Pedagogical Knowledge 

C3 


Surveys 

C2 


Observations 

C2 


Certification, Degrees 

C2 


Behaviors, Practices, Beliefs 

C3 


Surveys 

C2 


Observations 

C2 


Teacher Experience 

C2 

Teacher Quantity 


MSP Award Quantity 

C3 


Teachers Recruited/Participation 

C3 


Hours/Days Teacher Training 

C2 


Teachers Retained 

Cl 


University-Level Quantity 

C2 


Preservice Enrollment 

C2 


Program Completion 

Cl 


School-Level Quantity 

C2 


Teacher Mobility 

C2 


Teachers Retained 

Cl 


Teachers Hired 

Cl 

Teacher Diversity 


Demographic Data/Race and Ethnicity 

C2 


Minorities Recruited 

Cl 


Minorities Receiving Scholarships 

Cl 


Note: A^= 48 awards. C3 = representations identified by 70 - 100% of the 48 awards; C2 
= representations identified by 40 - 69% of awards; Cl = representations identified by 10 
- 39% of awards; and CO = representations identified by 0 - 9% of awards. 


Representations that characterized teacher quality. Awardees reported 
various representations to eharaeterize the quality of individual teaehers. 
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Essentially these representations were a way for awardees to operationalize 
teaeher quality eharaeteristies within their award aetivities. Subjeet knowledge 
(C3), pedagogieal knowledge (C3), and behaviors, praetiees, and beliefs 
(C3) were identified most frequently among awardees as eharaeteristies of 
individual teaeher quality. Awardees use of representations for teaehers’ 
subjeet knowledge, pedagogieal knowledge, and behaviors, praetiees, and 
beliefs was eonsistent with the researeh literature on eharaeteristies of teaeher 
quality. A lesser number of awardees diseussed teaeher experienee (C2) and 
general ability (Cl) as a representation of teaeher quality. This is a divergenee 
from the researeh literature where teaeher experienee and general ability are 
frequently used as representations of teaeher quality. 

We further unpaeked subjeet knowledge, pedagogieal knowledge, and 
behaviors, praetiees, and beliefs to determine what represented these eonstruets 
for awardees. In terms of subjeet knowledge, the most eommon representation 
was a seore on a test of mathematies or seienee subjeet knowledge (C2). Tests 
ineluded standardized tests, tests developed by awardees themselves, or tests 
developed by Researeh Evaluation and Teehnieal Assistanee (RETA) awards 
in the MSP Program. Another eommon representation of a teaehers’ subjeet 
knowledge was the teaeher ’s subjeet preparation, ineluding subjeet-speeifie 
eertifieation, degrees, and eourses taken in mathematies or seienee eontent 
(C2). 

In terms of pedagogieal knowledge, the representations reported by 
awardees differed from subjeet knowledge in type and frequeney. The most 
frequently-used representations of pedagogieal knowledge reported by 
awardees were responses on surveys, observations of teaehing, and teaehers’ 
eertifieation or degree (all designated as C2). Surveys and observations 
doeumented teaehers’ knowledge of state and national standards, use of 
standards-based eurrieula, and use of reform-oriented teaehing methods and 
materials. Unlike subjeet knowledge, where seores on tests were a frequently 
used representation of teaeher knowledge (C2), seores on tests were one of 
the least likely representations of pedagogieal knowledge (CO). A diseussion 
of the speeifie instruments used by awardees to assess teaeher knowledge is 
presented in another publieation of the MSP Program Evaluation (MSP-PE) 
(Moyer-Paekenham, Bolyard, Kitsantas, & Oh, in press). 

The most eommon representations of mathematies and seienee teaehers’ 
behaviors, praetiees and beliefs were responses on a survey and behavioral 
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observations (both C2). Surveys and observation protoeols were designed 
to doeument ehanges in teaehers’ beliefs and elassroom praetiees. Other 
representations of teaehers’ behaviors, praetiees, and beliefs that were 
deseribed with less frequeney ineluded responses to interview questions and 
written doeuments (both Cl). 

Representations that characterized teacher quantity. All of the awards 
reported some form of information on teaeher quantity. Awardees represented 
teaeher quantity in three main sub-eategories: MSP Award Quantity, University- 
Level Quantity, and School-Level Quantity. MSP Award Quantity ineluded 
data eolleeted on partieipants in MSP Award aetivities; University-Level 
Quantity ineluded data eolleeted on partieipants involved in eourses and 
programs of a partieipating university; and Sehool-Level Quantity ineluded 
data eolleeted on partieipants from the partieipating sehools. In the sub- 
eategory, MSP Award Quantity, most awardees eolleeted data on the number of 
teaehers partieipating in award aetivities (C3). Other data in this sub-eategory 
traeked numbers of hours or days of training eompleted by teaehers (C2), and 
numbers of teaehers eontinuing in MSP aetivities from year to year (Cl). The 
sub-eategory University-Level Quantity was represented by the number of 
preserviee enrollments in university programs (C2) and the number of teaehers 
eompleting university programs (Cl), where the university programs were 
part of the aetivities of the award. In the sub-eategory Sehool-Level Quantity, 
the most eommon representation was numerieal and deseriptive information 
about the mobility of teaehers in sehools where those teaehers were also award 
partieipants (C2). Awardees deseribed teaehers and distriet eontaets retiring, 
teaehers leaving or being laid off from the sehool system, and the termination 
of sehool positions. With less frequeney, awardees deseribed the retention of 
teaehers in partieipating MSP sehools (Cl) and numbers of MSP partieipants 
hired by sehool systems (Cl). 

Representations that characterized teacher diversity. While teaeher 
diversity (i.e., raee/ethnieity) was diseussed frequently in award doeuments, 
many of these ineluded general statements sueh as, “teaeher diversity is one 
of the projeet’s key features” or “inereasing diversity is an important goal.” 
Awardees reported a desire for inereasing the number of minority students 
in teaeher training programs or inereasing minority hires in sehool distriets; 
however, some reports laeked detailed information on how the award would 
doeument an inerease in the diversity of its partieipating teaehers. Of the 
awards that did provide this information, many were traeking demographie 
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data that focused on changes in the diversity of the mathematics and science 
teachers participating in the award (C2). Some awards discussed increases 
in the number of minorities recruited to award activities (Cl) and minority 
students receiving scholarships (Cl) as representations of increases in teacher 
diversity. Information on gender appeared in few reports (CO). 

Interventions 

Awardees discussed a variety of interventions designed to influence 
teacher characteristics within their partnerships. Some interventions influenced 
one area (quality, quantity, or diversity) more than another, but to some degree 
the interventions impacted multiple areas and characteristics. The most 
common interventions reported by awardees are grouped by the frequency 
with which they appeared in awardees’ documents and presented in Table 2. 
These interventions include: Inservice Training/Professional Development 
(C3), Preservice Training (C3), Teacher Leadership (C3), Recruiting (C3), 
Linking STEM Faculty with Teachers (C2), Stipends/Compensation (C2), 
and Induction (Cl). The following sections further unpack the most common 
interventions by providing examples from awardees’ activities. 

Interventions focusing on the quality of inservice and preservice teacher 
training. Inservice Training/Professional Development (PD) for individual 
teachers was discussed in all of the awards. These interventions included 
courses, workshops, institutes, and other teacher training activities, including 
those leading to certification and degrees in mathematics and science. New 
certification programs for teachers were reported in a number of awards (C2), 
most commonly as a way to develop certification and endorsement options 
to meet the “highly qualified” status or to obtain an add-on certificate or 
endorsement in addition to teacher licensure. For example, one certification 
program for elementary teachers included five mathematics content courses 
that were specially designed to increase subject knowledge. Other certification 
options for inservice teachers included a summer certification in secondary 
mathematics and National Board Certification. Most certification efforts 
focused on ensuring that those teaching mathematics and science were certified 
to teach those subjects. Many of these inservice training and professional 
development interventions were paired with teacher leadership. 

All awardees described some form of teacher leadership in their 
documents (C3). Additionally, teacher leadership was described in all grade 
bands (elementary, middle, secondary), in both mathematics and science. 
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Table 2 


Frequency of Interventions Reported by Awardees to Influence 
Teacher Characteristics 


Interventions 

Examples 

Frequency 

Inservice Training/ 
Professional Development 

Courses, Workshops, Institutes (including 
those leading to Certification and Degrees); 
Increasing Subject Knowledge 

C3 

Preservice Training 

New Course and Program Development 
(including those leading to Certification and 
Degrees); Increasing Subject Knowledge; 
Revising Student Teaching 

C3 

Teacher Leadership 

Formal and Informal Roles (including 
Coaches, Mentor Teachers, Lead Teachers, 
Department Chairs, Curriculum Specialists, 
Master Teachers) 

C3 

Recruiting 

Numbers Recruited to MSP and University 
Activities; Targeted Recruiting Activities for 
Minority Teachers 

C3 

Linking STEM Faculty with 
Teachers 

STEM Faculty Teaching Courses, Providing 
Expertise, Designing New Programs 

C2 

Stipends/Compensation 

Financial and Material Incentives (including 
stipends, tuition waivers, classroom sets of 
materials, manipulatives, science equipment, 
laptops and calculators) 

C2 

Induction 

Mentoring New STEM Teachers 

Cl 


Note: A^= 48 awards. C3 = interventions identified by 70 - 100% of the 48 awards; C2 = 
interventions identified by 40 - 69% of awards; Cl = interventions identified by 10 - 39% 
of awards; and CO = interventions identified by 0 - 9% of awards. 


and in formal teacher leader positions within the award, school system, or 
university. Examples of teacher leadership roles included coaches, mentor 
teachers, lead teachers, department chairs, curriculum specialists, master 
teachers, and locally-based staff developers. In some cases awardees utilized 
teacher leadership roles already in place in the school system (i.e., department 
chairperson or curriculum specialist); while in others, teacher leadership roles 
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were eonstmeted as part of the award’s aetivities. The largest responsibility of 
teaeher leaders deseribed by awardees was to provide professional development 
for inserviee teaeher training (C3). The professional development delivered 
by teaeher leaders ineluded using teaeher networks and professional learning 
eommunities (PLCs), peer observations and feedbaek, peer eoaehing, peer 
support struetures, and study groups (C2). To a lesser extent, teaeher leaders 
engaged in eurrieulum work, helped to set and aehieve sehool and MSP 
goals, and performed administrative tasks (all designated as Cl). Training for 
leaders was reported in many awards (C3), with the most eommon attributes 
of leadership training being the development of the teaeher leaders’ subjeet 
knowledge, leadership skills, dispositions, and pedagogieal strategies (all 
designated as C2). 

Most of the inserviee teaeher training/professional development (PD) 
foeused on developing teaehers’ knowledge in terms of eontent and pedagogy 
(C3). Efforts to improve or inerease teaehers’ subjeet and pedagogieal 
knowledge were eommonly deseribed as intertwined, with awardees using 
terminology sueh as pedagogical content knowledge (Shulman, 1986) and 
mathematical knowledge for teaching (Ball, 1991). A foeus on subjeet 
knowledge is traditionally emphasized for high sehool teaehers; however, 
awardees in this program emphasized subjeet knowledge for teaehers at all 
grade levels. 

Other PD aetivities ineluded a variety of elements. Awardees frequently 
deseribed the use of eurrieulum materials (C3) in their PD aetivities, ineluding 
FOSS kits. Developing Mathematieal Ideas (DMI), Great Explorations in 
Math and Seienee (GEMS), and standards-based NSF-funded eurrieulum 
materials. The use of inquiry seienee during PD aetivities was reported often 
(C2). Other PD work foeused on assessment, sueh as developing various 
methods of student assessment, developing test items, and interpreting test 
item data (C2). PD seminars foeused on analyzing students’ thinking using 
student produets and videotaped episodes of students working (C2). Awardees 
ineorporated the use of mathematies and seienee standards doeuments (C2) 
in an effort to understand the eontents of the standards doeuments and align 
standards with instruetion. They also used teehnology and mathematies tools 
(ineluding manipulatives) (C2). 

In addition to the teaeher quality interventions foeused on inserviee 
teaehers, there were also teaeher quality interventions foeused on preserviee 
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teachers (C2), with the most common of these focusing on the development 
of new courses and new programs for preservice teachers that would lead 
to certification and degrees. Awardees created subject-focused preparation 
programs in mathematics and science at various levels throughout K-12, and 
alternative certification programs for mathematics and science majors. New 
course offerings specifically focused on increasing preservice teachers’ subject 
knowledge (Cl) (e.g., courses such as Linear Algebra, Cells and Molecules, 
and Discrete Probability and Statistics). Other awardees described revising 
student teaching programs and internships (Cl). 

Many preservice and inservice teacher quality interventions linked faculty 
in the fields of science, technology, engineering and mathematics (STEM) 
with K-12 teachers (C2). STEM faculty were identified as the providers and 
designers of multiple inservice and preservice teacher development activities 
among the awards, including those that were mathematics and science focused, 
those that focused on preservice recruitment, and those that were focused at 
the elementary, middle and high school levels (C2). (For a complete discussion 
of STEM faculty engagement, see Moyer et al., 2007). STEM faculty worked 
with education faculty, teachers, and teacher leaders to design, revise, and teach 
courses for teacher education programs, summer workshops, and in-service 
teacher programs in mathematics and science (C2). STEM faculty also served 
in management roles (such as directing project activities) or leadership roles 
(such as directing the development of a new course or course sequence for 
mathematics and science teachers) (C2). In some awards, STEM faculty served 
in advisory or “expert” roles, including attending professional development 
sessions to provide on-site support, participating in study groups, or being 
available for online discussions and mentoring (Cl). The increased presence 
of STEM faculty in was reported as a means for increasing teachers’ subject 
knowledge. 

Interventions focusing on teacher quantity and diversity. All awardees 
reported recruiting as the most common intervention for influencing teacher 
quantity and diversity (C3). Some awardees’ recruiting plans included a focus 
on diverse students with scholarship offers to minority students entering 
teacher training programs and other support structures to promote minority 
enrollment in programs leading to mathematics and science teaching careers 
(Cl). STEM faculty involvement was common in the recruiting activities 
for preservice teachers (C2). As discussed previously, many awards utilized 
teacher leadership in their interventions. In addition to working to support 
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the professional development of inserviee teaehers, teaeher leaders also 
impaeted teaeher quantity and diversity. By serving as mentor and master 
teaehers they were part of the reemiting and induetion proeess for bringing 
new mathematies and seienee teaehers into the profession, ineluding those 
from minority populations, thereby influeneing the quantity of new teaehers 
and the diversity of the teaehing foree. 

Other reemiting aetivities to inerease the numbers of mathematies and 
seienee teaehers ineluded providing sehool-based experienees matehing 
reemits with exemplary teaehers (Cl); developing reemiting tools, doeuments, 
reeruitment videos, broehures, and information sessions about eareers in 
teaehing (Cl); attraeting university STEM students into teaehing programs 
(Cl); designing mentoring programs for high sehool students to reeruit 
them into teaehing (Cl); engaging high sehool and university students in 
mathematies and seienee aetivities with younger students to promote interest 
in teaehing as a eareer (Cl); and forming after-sehool seienee and future 
teaeher elubs in high sehools (Cl). 

The most frequently-reported representation of teaeher quantity was 
the number of teaehers partieipating in award aetivities; therefore, stipends 
and eompensation were viewed as an intervention to potentially inerease 
partieipation and, thereby, inerease teaeher quantity for the award (C2). The 
types of stipends and eompensation reported by awardees to inerease teaeher 
partieipation ineluded: stipends for partieipating in inserviee training and 
PD aetivities (C2), stipends for serving in new leadership roles (Cl), tuition 
waivers or reimbursements for university eourses (Cl), and elassroom sets of 
materials ineluding mathematies manipulatives, seienee equipment, laptops 
and ealeulators (Cl). 

Teaeher induetion was deseribed as an intervention to influenee teaeher 
quantity and diversity, but with less frequeney than the other interventions 
previously diseussed (Cl). Induetion aetivities were deseribed as formal and 
informal events ranging in duration. Common induetion experienees were 
deseribed as on-site PD, new teaeher workshops, and Saturday seminars (Cl). 
Some induetion experienees were provided by teaeher eoaehes, through study 
groups, or as online mentoring, ineluding one-to-one mentoring, as well as 
group induetion aetivities for mathematies and seienee teaehers (Cl). 
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Limitations 

One of the benefits of examining an entire group of awards for themes is 
also a limitation. While researehers gained valuable insights about the entire 
portfolio of awards, detailed deseriptions of individual awards eould not be 
highlighted. Beeause researehers believed that insights from the portfolio of 
awards may bring to the fore the value of the program as a whole, we ehose 
this method of broad examination. Eaeh award has its own evaluation in plaee 
and these individual evaluations may bring to light unique eharaeteristies of 
the individual awards. Beeause this analysis provides a view of the awards as 
one entity, major shifts in teaeher quality, quantity, and diversity work aeross 
the awards ean be identified. 

The deseriptive and narrative nature of awardees’ doeuments was a 
limiting faetor in the analysis. Self-report doeuments prepared by awardees 
may not provide a eomplete and aeeurate aeeount of the full seope or impaet of 
awardees’ aetivities. In some eases the use of terms was unelear, or a referenee 
to a partieular group or aetivity was ineomplete. However, researehers in the 
present study believed that awardees had some ehoiee in what to inelude in 
their doeuments. These seleetions were indieative of what awardees found of 
most importanee to their work. The self-seleetion of information to inelude in 
the reports and the seetions of the reports where information was expanded 
upon or limited were important data in and of themselves. While eertain aspeets 
of reporting were required aeross the program, there was still great latitude in 
the level of deseription awardees were required and permitted to submit as a 
report, as evideneed by the range in the length of their reports. 

Discussion 

These results provide a broad view of the work of awardees in a major 
mathematies and seienee program foeused on influeneing teaeher quality 
eharaeteristies. The findings illustrate how awardees represent teaeher quality 
eharaeteristies in their work and what interventions they report as influenees 
on those eharaeteristies. Several key findings emerge from our analyses. 

Improving Individual Teacher Quality 

eharaeteristies of individual teaehers, in partieular subjeet andpedagogieal 
knowledge, are diseussed extensively in the doeuments. Awardees’ language 


Journal of Educational Research & Policy Studies 


25 

on teacher knowledge emphasizes the importance of subject knowledge, 
and this emphasis is similar to recent policy and professional organization 
statements, as well as research (Darling-Hammond, 2000; Ferguson & 
Womack, 1993; Goldhaber & Brewer, 1997a; Monk, 1994; Wilson & Floden, 
2003). In addition, there is an evident shift across this program of awards to 
place increased emphasis on the development of subject knowledge, not just 
for middle and high school teachers, but also for elementary school teachers, 
as evidenced by the course and program development for inservice teachers 
at the elementary level. This knowledge is specialized to the work of teachers 
at this level (Ball, 1991). While certification for elementary teachers does not 
currently require additional mathematics and science coursework, the emphasis 
in this portfolio of awards could indicate a future trend in the preparation and 
professional development of elementary teachers targeted toward specialized 
knowledge for teaching mathematics and science. In addition, the prominence 
of subject preparation at all levels among the awards places renewed emphasis 
on the importance of middle school teachers having strong preparation in 
mathematics and science content. 

While much of the pure research in the general domain of teacher 
quality uses characteristics such as years of experience, general ability, and 
certification status as representations of teacher quality, awardees in the present 
study were more likely to focus on teachers’ subject knowledge, pedagogical 
knowledge, and behaviors, practices, and beliefs. In the context of this awards 
program, these results are not surprising. The awards are funded based on a set 
of project-specific goals and plans for demonstrating and assessing progress 
towards those goals. It makes sense that awardees would focus on subject 
matter knowledge, pedagogical knowledge, and behaviors, practices and 
belief, because these are characteristics of teachers over which awardees’ work 
may have some influence. Teacher quality is a complex construct. Awardees’ 
use of multiple representations and interventions reveals their awareness of 
the complexity inherent in influencing these constructs. An awareness of this 
complexity also makes them better able to focus on documenting teacher 
growth as it relates to teachers’ participation in the activities of the award. 

The findings show that awardees have adopted research-based practices in 
the design of professional development experiences (Loucks-Horsley, Hewson, 
Love, & Stiles, 1998). For example, a large-scale empirical comparison on 
the effects of characteristics of professional development on teacher learning 
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found significant positive effects on three core features: focusing on content 
knowledge, promoting active learning, and fostering coherence with other 
learning activities (Garet, Porter, Desimone, Birman, & Yoon, 2001). The study 
also found that structural features, including type of activity, duration of the 
activity, and collective participation, significantly affect teacher learning. In 
the present study, awardees demonstrate a strong emphasis on mathematics and 
science subject preparation and PD that contains active learning. Coherence 
and collective participation were fostered by using teacher learning networks 
in the same subject areas, grade levels, and schools. These characteristics 
indicated that awardees were knowledgeable about the types of interventions 
that have been shown to be effective in influencing growth in mathematics 
and science teachers. 

Improving Teacher Quantity and Diversity 

Tracking the quantity and diversity of the teachers engaged in these 
awards is documented at multiple levels across the program. While these 
data are a constantly moving target for awardees, most were able to report 
participation and demographic data on their teacher participants. In terms 
of influencing teacher quantity, some of the most commonly reported data 
were the numbers of participants recruited to the award and its activities. The 
research on teacher quantity indicates that teacher turnover is a primary reason 
that additional mathematics and science teachers are needed each year to fill 
vacancies in K-12 schools (Ingersoll, 2006a; 2006b). For this reason, awardees 
could place additional emphasis on induction, mentoring, and retention efforts 
for mathematics and science teachers so that these individuals remain in the 
teaching profession. 

While some of the factors that cause mathematics and science teachers 
to leave the profession are out of the control of the awards (i.e., salaries, 
administrative support, student behavior, and student motivation) (Ingersoll, 
2006a), there are a variety of retention strategies that can be implemented to 
offset these negative influences. One important reason for awardees to focus 
on retention efforts that influence the quantity of mathematics and science 
teachers is that support structures that are put into place now have the potential 
to last beyond the life of the award. These support structures could influence 
the retention of mathematics and science teachers in a school or a district long 
after the award funding ends. In addition, there are many potential findings that 
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could emerge by viewing the eolleetive efforts of these awards to influenee 
mathematies and seienee teaeher quantity. Aeross the program of awards, 
potential studies eould examine retention efforts that are partieularly effeetive 
under applied eonditions, providing additional evidenee on ways of retaining 
mathematies and seienee teaehers. 

As with teaeher quantity, influeneing teaeher diversity involves ehanging 
population eharaeteristies rather than eharaeteristies of individual teaehers, and 
ehanging population eharaeteristies takes time. Researeh on teaeher diversity 
indieate a number of strategies for inereasing the diversity of the teaehing foree 
over time. Some of these inelude: improving K-12 edueation for minority 
students, early identifieation, targeted reeruiting, and support through various 
stages of teaeher edueation (i.e., initial eertifieation, induetion, on-going 
professional development) (Clewell & Villegas, 1998; Darling-Hammond 
et al., 1996; Holloway, 2002; Jorgenson, 2001; Loving & Marshall, 1997; 
Newby et al., 2000). The most eommon efforts direeted toward improving 
teaeher diversity among these awards involved reeruiting minority eandidates 
and implementing support struetures for minority eandidates. However, these 
aetivities were reported by a lesser number of awards (C 1 , 1 0 - 39% of awards). 
While some awardees have seleeted researeh-based implementation strategies 
for influeneing teaeher diversity, wide-spread use of these strategies was not 
evident in the doeuments reviewed during this analysis. 

Promising Interventions 

The involvement of STEM faeulty and Teaeher Leaders was evident 
throughout the portfolio of awards, aeross subjeet areas and grade levels, and 
among preserviee and inserviee teaeher development aetivities. The results 
showed STEM faeulty most eommonly involved as eourse instruetors, program 
designers, and eontent experts, whieh eapitalizes on the type of work STEM 
faeulty do at the university, and in some eases, pulls them out of the university 
environment and into K-12 sehools. For some this was unfamiliar territory, 
and STEM faeulty struggled to identify where they “fit in.” In addition, 
traditional university reward struetures for STEM faeulty often hinder their 
involvement in mathematies and seienee edueation work. However, as STEM 
faeulty and edueators worked through the design of the award’s aetivities, they 
gained a better understanding of eaeh other’s work. A diseussion by Hyman 
Bass in the Bulletin of the American Mathematical Society deseribes the long 
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tradition of contributions of noted research mathematicians to mathematics 
education work (Bass, 2005). He highlights the importance of mathematicians 
developing an understanding of the work of K-12 mathematics so that they can 
see ways that their own mathematical knowledge can contribute to solutions 
for mathematics education problems. As evidenced by these awards, many 
STEM and education faculty across the country are currently working together 
to improve mathematics and science education. 

As the awards end, it will be interesting to examine how the collaborative 
relationships formed among STEM faculty, education faculty, and K-12 
education will influence their future collaborative work in K-12 mathematics 
and science education. The MSP Program awards provided opportunities for 
university faculty and K-12 educators to understand each others’ professions, 
pedagogy, and language. Continuing initiatives have the potential to build 
upon the work stated during the award. In particular, the mathematics and 
science teacher turnover challenges faced by the field of education are also 
faced in STEM fields in terms of those earning STEM degrees. Recent reports 
show that the proportion of students earning degrees in STEM fields has also 
declined, and that factors contributing to this decline include sub par teacher 
quality at the high school and college levels and poor high school preparation, 
among others (Ashby, 2006). These are interrelated challenges that face both 
STEM and education faculty, providing a common goal in the improvement 
of mathematics and science teaching at all levels K-16. 

The findings suggest that awardees view teacher leadership as an 
important element in their intervention efforts for improving teacher quality, 
quantity, and diversity. While teacher leadership is a construct that has been 
examined in the literature for several decades (Hatch, White, & Faigenbaum, 
2005; Rowan, 1990; Smylie, 1994), recently, there has been increased interest 
in teacher leadership, including broader views of the construct, and its effects 
on teaching and learning (Spillane, Halverson, & Diamond, 2001 ; York-Barr & 
Duke, 2004). Much of the existing literature on teacher leadership focuses on 
formal roles of leadership, characteristics of teacher leaders, and conditions that 
facilitate teacher leadership development; less research focuses on the effects 
of teacher leadership, particularly on other teachers and students (Smylie, 
1995; York-Barr & Duke, 2004). The purposes of teacher leadership models 
in the literature include incentives to retain, reward, and motivate teachers; 
a means of improving teaching and learning by providing opportunities for 
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teacher development, growth, and collaboration; and a means of utilizing 
organizational resources in order to support and sustain reform efforts (Mijus & 
Harris, 2003; Smylie, 1995, 1996; Webb, Neumann, & Jones, 2004; York-Barr 
& Duke, 2004). These were common elements in the descriptions of leadership 
activities of the awardees. An underlying assumption among awardees’ was 
that teacher leadership was a vehicle for influencing teacher quality, quantity, 
and diversity in a systematic way. For example, when a science teacher leader 
with subject specific skills mentors a new minority science teacher, the teacher 
leader has the potential to influence the new teacher’s subject and pedagogical 
knowledge (influencing teacher quality), and to mentor and support the new 
minority teacher through the first few difficult years of teaching (influencing 
teacher quantity and diversity). 

Most of the existing research on the effects of teacher leadership has 
focused on the effects on teacher leaders themselves (York- Barr & Duke, 
2004). Evidence of the effects of teacher leadership outside the individual 
leader is more unclear. An important element for future research on teacher 
leadership is a focus on how leadership influences teachers and students at the 
classroom or “micro level” (Coggins, Stoddard, & Cutler, 2003). The awards 
in the present study are in a unique position to contribute to this research. 
With many awards engaged in teacher leadership work, and many different 
leadership configurations among the awards, there is much opportunity for 
research that has been absent from the literature. The impact of mathematics 
and science teacher leaders on the quality, quantity, and diversity of teachers 
is certainly worthy of further study, and awardees in this program are in the 
position to conduct this potentially meaningful research. 

Conclusion 

Several important insights have emerged from this examination. Among 
the awards there is a renewed emphasis on the importance of subject preparation 
for mathematics and science teachers, and in particular, a shift in emphasis to 
include specialized subject knowledge preparation for elementary teachers. 
This shift may have future effects on the design of preparation and professional 
development programs for teachers at the elementary level. Awardees in this 
program focus on the growth of teachers in terms of those characteristics 
over which they have influence, and at the same time they recognize the 
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complexity of influencing and documenting teacher change. The findings 
from their own research has the potential to inform educational research on 
effective practices for documenting teacher growth in applied settings. Efforts 
to influence teacher quantity and diversity are only in their initial stages 
for many awards, as these are population characteristics and changing the 
characteristics of a population takes time. The influence of Teacher Leaders 
and STEM faculty is prominent throughout the awards, as they are engaged 
in activities at all levels (K-12) and in both subject areas (mathematics and 
science). The foundation of collaboration developed during the activities of 
the awards, among university faculty and K-12 education, has the potential 
to continue to influence K-12 mathematics and science education for years to 
come. Through their work these awards have made gains toward improving 
the quality, quantity, and diversity of the mathematics and science teaching 
force. The value of these efforts will be revealed as awardees document and 
disseminate new knowledge from their initiatives and experiences. 




This research is part of the Math and Science Partnership Program 
Evaluation (MSP-PE), supported by Contract No. 0456995 from the National 
Science Foundation. The MSP-PE is led by COSMOS Corporation, with 
Robert K. Yin of COSMOS serving as Principal Investigator (PI) and Jennifer 
Scherer serving as one of three Co-Principal Investigators. Additional Co- 
Principal Investigators and their collaborating institutions (including discipline 
departments and mathematics centers) are Patricia Moyer-Packenham of 
George Mason University and Kenneth Wong of Brown University. Other 
collaborating institutions include Vanderbilt University and The McKenzie 
Group. Any opinions, findings, and conclusions or recommendations expressed 
in this material are those of the authors and do not necessarily reflect the views 
of the National Science Foundation. 


Journal of Educational Research & Policy Studies 


References 


31 


Adams, P. E., & Krockover, G. H. (1997). Beginning science teacher cogni- 
tion and its origins in the preservice secondary science teacher program. 
Journal of Research in Science Teaching, 34, 633-653. 

Alliance for Excellent Education. (2004). Tapping the potential: Retaining 
an developing high-quality new teachers. Washington, DC: Author. 

American Statistical Association. (2007). Using statistics effectively in 
mathematics education research. Retrieved February 25, 2007, from 
http://www.amstat.org/research_grants/pdfs/SMERReport.pdf 

Ashby, C. M. (2006). Science, technology, engineering, and mathematics 
trends and the role of federal programs (GAO-06-702T). Washington, 
DC: US Government Accountability Office. 

Ball, D. (1991). Research on teaching mathematics: Making subject matter 
knowledge part of the equation. In J. Brophy (Ed.), Advances in Research 
on Teaching (Vol. 2, pp. 1-41). Greenwich: JAI Press. 

Bass, H. (2005). Mathematics, mathematicians, and mathematics education. 
Bulletin of the American Mathematical Society, 42(4), 417-430. 

Bogdan, R. C., & Biklen, A. K. (1998). Qualitative research for education: 
An introduction to theory and methods. Boston: Allyn and Bacon. 

Bolyard, J. J., & Moyer-Packenham, P. S. (in press). A review of the lit- 
erature on mathematics and science teacher quality. Peabody Journal of 
Education. 

Burkam, D. T., Eee, V. E., & Smerdon, B. A. (1997). Bender and science 
learning in early high school: Subject matter and laboratory experiences. 
American Educational Research Journal, 34, 297-331. 

Chaney, B. (1995) Student outcomes and the professional preparation of 
eighth-grad teachers in science and mathematics. Arlington, VA: Nation- 
al Science Foundation. (ERIC Document Reproduction Service No. ED 
389530) 

Clewell, B. C., & Villegas, A. M. (1998). Diversifying the teaching force 
to improve urban schools: Meeting the challenge. Education and Urban 
Society, 31, 3-17. 


Fall 2006 / Volume 6, Number 2 


32 

Coggins, C. T., Stoddard, R, & Cutler, E. (2003, April). Improving instruc- 
tional capacity through school-based reform coaches. Paper presented at 
the annual meeting of the Ameriean Edueational Researeh Assoeiation, 
Chieago, IE. 

Couneil of Seientifie Soeiety Presidents. (2004). The need for well-qualified 
science and math teachers. Retrieved Mareh 5, 2006, from the Couneil 
of Seientifie Soeiety Presidents Web site: www.netm.org/news/2004_12_ 
essp_position.pdf 

Conferenee Board of the Mathematieal Seienees (CBMS). (2001). The 
Mathematical Education of Teachers - Issues on Mathematics Education 
(vol. 11). Providenee, RE Ameriean Mathematieal Soeiety. 

Dandy, E. B. (1998). Inereasing the number of minority teaehers: Tapping 
the paraprofessional pool. Education and Urban Society, 31, 89-103. 

Darling-Hammond, L. (2000). Teaeher quality and student aehievement: 

A review of state poliey evidenee. Educational Policy Analysis Archives, 
^(1). Retrieved February 2005 from http://epaa.asu.edu/epaa/v8nl 

Darling-Hammond, L., Berry, B., & Thoreson, A. (2001). Does teaeher eer- 
tifieation matter? Evaluating the evidenee. Educational Evaluation and 
Policy Analysis, 23, 51-11 . 

Darling-Hammond, L., Dilworth, M. E., & Bullmaster, M. (1996). Educa- 
tors of Color. Washington, DC: National Allianee of Blaek Sehool Eduea- 
tors. (ERIC Doeument Reproduetion Serviee No. ED474898) 

Darling-Hammond, L., & Youngs, P. (2002). Defining “highly qualified 
teaehers”: What does “seientifieally-based researeh” aetually tell us? Edu- 
cational Researcher, 31{9), 13-25. 

Druva, C. A., & Anderson, R. D. (1983). Seienee teaeher eharaeteristies by 
teaeher behavior and by student outeome: A meta-analysis of researeh. 
Journal of Research in Science Teaching, 20, 467-479. 

Ehrenberg, R. G., & Brewer, D. J. (1994). Do sehool and teaeher eharae- 
teristies matter? Evidenee from High Sehool and Beyond. Economics of 
Education Review, 13{\), 1-17. 

Ehrenberg, R. G., & Brewer, D. J. (1995). Did teaehers’ verbal ability and 
raee matter in the 1960s? Coleman revisited. Economics of Education 
Review, 74(1), 1-21. 


Journal of Educational Research & Policy Studies 


33 

Ehrenberg, R. G., Goldhaber, D., D., & Brewer, D. J. (1995). Do teaehers’ 
raee, gender, and ethnieity matter? Evidenee from the National Eduea- 
tional Longitudinal Study of 1988. Industrial and Labor Relations Re- 
view, 48, 547-561. 

Evertson, C. M., Hawley, W. D., & Zlotnik, M. (1985). Making a differenee 
in edueational quality through teaeher edueation. Journal of Teacher Edu- 
cation, 36(3), 2-12. 

Ferguson, R, & Womaek, S. T. (1993). The impaet of subjeet matter and 
edueation eoursework on teaehing performanee. Journal of Teacher Edu- 
cation, 44, 55-63. 

Ferguson, R. F. (1991). Paying for publie edueation: New evidenee on how 
and why money matters. Harvard Journal on Legislation, 28, 465-498. 

Ferguson, R. F., & Ladd, H. F. (1996). How and why money matters: An 
analysis of Alabama sehools. In H. F. Ladd (Ed.), Holding schools ac- 
countable: Performance-based reform in education (pp. 265-298). Wash- 
ington, DC: Brookings Institution. 

Fetler, M. (1999). High sehool staff eharaeteristies and mathematies test 
results. Education Policy Analysis Archives, 7(9). Retrieved from http:// 
epaa.asu.edu/epaa/v7n9 

Ferrini-Mundy, J., & Sehmidt, W. H. (2005). International eomparative 
studies in mathematies edueation: Opportunities for eollaboration and 
ehallenges for researehers. Journal for Research in Mathematics Educa- 
tion, 36(3), 164-175. 

Fraenkel, J. R., & Wallen, N. E. (1993). How to design and evaluate re- 
search in education (2^^ ed.). New York: MeGraw-Hill, Ine. 

Garet, M. S., Porter, A. C., Desimone, L., Birman, B. F., & Yoon, K. S. 
(2001). What makes professional development effeetive? Results from 
a national sample of teaehers. American Educational Research Journal, 
5^(4), 915-945. 

Gess-Newsome, J., & Lederman, N. G. (1993). Preserviee biology teaehers’ 
knowledge struetures as a funetion of professional teaeher edueation: A 
yearlong assessment. Science Education, 77, 25-45. 

Goe, L. (2002). Legislating equity: The distribution of emergeney permit 
teaehers in California. Education Policy Analysis Archives, 10(42). Re- 
trieved June 2, 2005, from http://epaa.asu.edu/vl0n42/ 


Fall 2006 / Volume 6, Number 2 


34 

Goldhaber, D. D., & Brewer, D. J. (1997a). Evaluating the effeet of teaeher 
degree level on edueational performanee. In W. J. Fowler (Ed.), Develop- 
ments in School Finance, 1996 (pp. 197-210). Washington, DC: National 
Center for Edueation Statisties, U.S. Department of Edueation. 

Goldhaber, D. D., & Brewer, D. J. (1997b). Why don’t sehools and teaeh- 
ers seem to matter? Assessing the impaet of unobservables on edueational 
produetivity. The Journal of Human Resources, 32, 505-523. Retrieved 
May 25, 2005, from JSTOR database. 

Goldhaber, D. D., & Brewer, D. J. (2000). Does teaeher eertifieation mat- 
ter? High sehool teaeher eertifieation status and student aehievement. 
Educational Evaluation and Policy Analysis, 22(2), 129-146. 

Greenwald, R., Hedges, E. V., & Eaine, R. D. (1996). The effeet of sehool 
resourees on student aehievement. Review of Educational Research, 66, 
361-396. 

Guarino, C. M., Hamilton, E. S., Eoekwood, J. R., & Rathbum, A. H. 
(2006). Teacher qualifications, instructional practices, and reading and 
mathematics gains of kindergarteners. Research and development report 
(NCES No. 2006-031). Washington, DC: National Center for Edueation 
Statisties. 

Guyton, E., & Farokhi, E. (1987). Relationships among aeademie per- 
formanee, basie skills, subjeet matter knowledge, and teaehing skills of 
teaeher edueation graduates. Journal of Teacher Education, 5^(5), 37-42. 

Hanushek, E. (1971). Teaeher eharaeteristies and gains in student aehieve- 
ment: Estimation using miero data. The American Economic Review, 61, 
280-288. 

Hanushek, E. (1992). The trade-off between ehild quantity and quality. 

The Journal of Political Economy, 100{\), 84-117. Retrieved January 20, 
2006, from JSTOR database. 

Hanushek, E. (1996). A more eomplete pieture of sehool resouree polieies. 
Review of Educational Research, 66, 397-409. 

Haselkom, D., & Fideler, E. (1996). Breaking the class ceiling: Paraeduca- 
tor pathways to teaching. Belmont: MA: Reeruiting New Teaehers. 


Journal of Educational Research & Policy Studies 


35 


Hatch, T., White, M. E., & Faigenbaum, D. (2005). Expertise, eredibility, 
and influenee: How teaehers ean influenee poliey, advanee researeh, and 
improve performanee. Teachers College Record, 107, 1004-1035. Down- 
loaded 5/4/06 from Blaekwell Synergy http://www.blaekwell-synergy. 
eom/toe/tere/ 107/5 

Hawk, P. R, Coble, C. R., & Swanson, M. (1985). Certifieation: It does 
mdiiiQX. Journal of Teacher Education, 36{3), 13-15. 

Hawk, P. R, & Sehmidt, M. W. (1989). Teaeher preparation: A eomparison 
of Traditional and alternative programs. Journal of Teacher Education, 
40(5), 53-58. 

Hawkins, E. F., Staneavage, F. B., & Dossey, J. A. (1998). Sehool polieies 
and praetiees affeeting instmetion in mathematies: Findings from the 
National Assessment of Edueational Progress. Washington, DC: U.S. De- 
partment of Edueation, Ofhee of Edueational Researeh and Improvement. 
(ERIC Doeument Reproduetion Serviee No. ED 424116) 

Hiebert, J., Gallimore, R., Gamier, H., Givvin, K. B., Hollingsworth, H., 
Jaeobs, J., et al. (2003). Teaching Mathematics in Seven Countries: Re- 
sults from the TIMSS 1999 Video Study (No. NCES 2003-013 Revised). 
Washington D.C.: U.S. Department of Edueation, National Center for 
Edueation Statisties. 

Hill, H. C., Rowan, B., & Ball, D. L. (2005). Effeets of teaehers’ mathemat- 
ieal knowledge for teaehing on student aehievement. American Educa- 
tional Research Journal, 42(2), 371-406. 

Holloway, J. H. (2002). Mentoring for diversity. Educational Leadership, 
59(6), 88-89. 

Houston, W. R., Marshall, F., & MeDavid, T. (1993). Problems of tradition- 
ally prepared and alternatively eertified first-year teaehers. Education and 
Urban Society, 26(1), 78-89. 

Ingersoll, R. M. (2001). Teaeher turnover and teaeher shortages: An orga- 
nizational analysis. American Educational Research Journal, 5^(3), 499- 
534. 

Ingersoll, R. M. (2006a). Is there really a shortage of mathematics and sci- 
ence teachers? Retrieved June 15, 2006, from http://hub.mspnet.org/in- 
dex.efm/ 12703 


Fall 2006 / Volume 6, Number 2 


36 

Ingersoll, R. M. (2006b). Understanding supply and demand among math- 
ematies and seienee teaehers. In J. Rhoton & R Shane (Eds.), Teaching 
Science in the 2T‘ Century, (pp. 197-2 11). Arlington, VA: NSTA Press. 

Johnson, S. M., Berg, J. H., & Donaldson, M. L. (2005). Who stays in 
teaching and why: A review of the literature on teacher retention. Cam- 
bridge, MA: Harvard Graduate Sehool of Edueation. Retrieved June 15, 
2006, from www.gse.harvard.edu/~ngt 

Johnson, S. M., & Birkeland, S. E. (2003). Pursuing a “sense of sueeess: 
New teaehers explain their eareer deeisions. American Educational Re- 
search Journal, 40{3), 581-617. 

Jorgenson, O. (2001). Supporting a diverse teaeher eorps. Educational 
Leadership, 5^(8), 64-67. 

Kirby, S. N., Berends, M., & Naftel, S. (1999). Supply and demand of mi- 
nority teaehers in Texas: Problems and prospeets. Educational Evaluation 
and Policy Analysis, 21, 47-66. 

Latham, A. S., Gitomer, D., & Zimonek, R. (1999). What the tests tell us 
about new teaehers. Educational Leadership, 56(8), 23-26. 

Lindquist, M. M. (2001). NAEP, TIMSS, and PSSM: Entangled influenees. 
School Science and Mathematics, 767(6), 286-291. 

Loueks-Horsley, S., Hewson, P. W., Love, N., & Stiles, K. E. (1998). De- 
signing professional development for teachers of science and mathemat- 
ics. Thousand Oaks, CA: Corwin Press, Ine. 

Loving, C. C., & Marshall, J. E. (1997). Inereasing the pool of ethnieally 
diverse seienee teaehers: A mid-projeet evaluation. Journal of Science 
Teacher Education, 8, 205-217. 

Lutz, F. W., & Hutton, J. B. (1989). Alternative teaeher eertifieation: Its 
poliey implieations for elassroom personnel praetiee. Educational Evalu- 
ation and Policy Analysis, 77, 237-254. 

MeMillan, J. H., & Wergin, J. F. (2002). Understanding and evaluating 
educational research (2"‘^ ed.). Upper Saddle River, New Jersey: Merrill 
Prentiee Hall. 

Mijus, D., & Harris, A. (2003). Teaeher leadership — improvement through 
empowerment? An overview of the literature. Educational Management 
and Administration, 31, 437-448. 

Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis (2nd 
ed.). Thousand Oaks, CA: Sage Publieations. 


Journal of Educational Research & Policy Studies 


37 

Miller, J. W., McKenna, M. C., & McKenna, B. A. (1998). A comparison of 
alternatively and traditionally prepared teachers. Journal of Teacher Edu- 
cation, 49, 165-176. 

Monk, D. H. (1994). Subject area preparation of secondary mathematics 
and science teachers and student achievement. Economics of Education 
Review, 75(2), 125-145. 

Monk, D. H., & King, J. A. (1994). Multilevel teacher resource effects in 
pupil performance in secondary mathematics and science: The case of 
teacher subject matter preparation. In R. G. Ehrenberg (Ed.), Choices 
and consequences: Contemporary policy issues in education (pp. 29-58). 
Ithaca, NY: ILR Press. 

Moyer, P. S., Kitsantas, A., Bolyard, J. J., Huie, F., Irby, N., & Oh, H. 
(2007). A focused analysis of MIS survey items: Who are the designers 
and providers of preservice and inservice teacher activities in the MSP 
Program? Unpublished manuscript. 

Moyer-Packenham, P. S., Bolyard, J. J., Kitsantas, A., & Oh, H. (in press). 
The assessment of mathematics and science teacher quality. Peabody 
Journal of Education. 

Mumane, R. J., & Phillips, B. R. (1981). What do effective teachers of in- 
ner-city children have in common? Social Science Research, 10, 83-100. 

National Commission on Mathematics and Science Teaching for the 2P^ 
Century. (2000). Before it’s too late: A report to the nation from the na- 
tional commission on mathematics and science teaching for the 2P* cen- 
tury. Washington, DC: U.S. Department of Education. Retrieved February 
20, 2007 from http://www.ed.gov/inits/Math/glenn/report.pdf 

National Council of Teachers of Mathematics. (1991). Professional stan- 
dards for teaching mathematics. Reston, VA: Author. 

National Council of Teachers of Mathematics. (2005). Highly qualified 
teachers. Retrieved April 25, 2006 from http://www.nctm.org/about/posi- 
tionstatements/ qualified.htm 

National Research Council. (1996). National Science Education Standards. 
Retrieved February 22, 2007 from the National Academies Web site: 
http : //books . nap . edu/ readingroom/books/ nses/4 . html 

National Science Foundation. (2007). MSP goals, structure and composi- 
tion. Retrieved February 21, 2007, from http://www.nsf.gov/ehr/MSP/ 
nsf05069_3.jsp 


Fall 2006 / Volume 6, Number 2 


38 

National Science Teachers Association. (2002, February). Learning condi- 
tions for high school science. Retrieved April 25, 2006, from http://www. 
nsta.org 

National Science Teachers Association. (2004, July). Science teacher prep- 
aration. Retrieved April 25, 2006, from http://www.nsta.org 

Neild, R. C., Useem, E., Travers, E. F., & Eesnick, J. (2003). Once & for 
all: Placing a highly qualified teacher in every Philadelphia classroom. 
Philadelphia, PA: Research for Action. 

Newby, D. E., Swift, K. E., & Newby, R. G. (2000). Encouraging and re- 
cruiting students of color to teach. Multicultural Education, ^(1), 8-14. 

No Child Eeft Behind Act of 2001, Pub. E. No. 107-110, 115 Stat. 1425 

( 2002 ). 

Patton, M. Q. (1990). Qualitative Evaluation and Research Methods (2nd 
ed.). Thousand Oaks, CA: Sage Publications. 

Peterson, P. E., Fennema, E., Carpenter, T. R, & Eoef, M. (1989). Teachers’ 
pedagogical content beliefs in mathematics. Cognition and Instruction, 6, 
1-40. 

Rice, J. K. (2003). Teacher quality: Understanding the effectiveness of 
teacher attributes. Washington, DC: Economic Policy Institute. 

Riley, R. W. (1998). Our teachers should be excellent, and they should look 
like America. Education and Urban Society, 31, 18-29. 

Rivkin, S. G., Hanushek, E. A., & Kain, J. F. (2005). Teachers, schools, and 
academic achievement. Econometrica, 73(2), 417-458. 

Rowan, B. (1990). Commitment and control: Alternative strategies for the 
organizational design of schools. Review of Research in Education, 16, 
353-389. 

Rowan, B. Correnti, R., & Miller, R. J. (2002). What large-scale, survey 
research tells us about teacher effects on student achievement: Insights 
from the Prospects study of elementary schools. Teachers College Re- 
cord, 104, 1525- 1567. 

Sandlin, R. A., Young, B. E., & Karge, B. D. (1992). Regularly and alterna- 
tively credentialed beginning teachers: Comparison and contrast of their 
development. in Teacher Education, 14(A), 16-23. 

Shen, J. (1998). Alternative certification, minority teachers, and urban edu- 
cation. Education and Urban Society, 31(2), 30-41. 


Journal of Educational Research & Policy Studies 


39 


Shen, J., Wegenke, G. L., & Cooley, V. E. (2003). Has the publie teaehing 
foree beeome more diversified? National and longitudinal perspeetives on 
gender, raee, and ethnieity. Educational Horizons, 81, 112-118. 

Shulman, L. S. (1986). Those who understand: Knowledge growth in teaeh- 
ing. Educational Researcher, 15{2), 4-14. 

Silver, E. A., & Kenney, P. A. (2000). Results from the seventh mathematics 
assessment of the National Assessment of Educational Progress. Reston, 
VA: National Couneil of Teaehers of Mathematies. 

Smith, T. M., & Ingersoll, R. M. (2004). What are the effeets of induetion 
and mentoring on beginning teaeher turnover? American Educational 
Research Journal, 47(3), 681-714. 

Smylie, M. A. (1994). Redesigning teaehers’ work: Conneetions to the 
elassroom. In E. Darling-Hammond (Ed.), Review of research in educa- 
tion (Vol. 20, pp. 129-177). Washington, DC: Ameriean Edueational Re- 
seareh Assoeiation. 

Smylie, M. A. (1995). New perspeetives on teaeher leadership. Elementary 
School Journal, 96, 3-7. 

Smylie, M. A. (1996). From bureaueratie eontrol to building human eapi- 
tal: The importanee of teaeher learning in edueation reform. Educational 
Researcher, 25(9), 9-11. 

Spillane, J. R, Halverson, R., & Diamond, J. B. (2001). Investigating 
sehool leadership praetiee: A distributed perspeetive. Educational Re- 
searcher, 30(3), 23-28. 

Stake, R. E. (1995). The art of case study research. Thousand Oaks, CA: 
SAGE Publieations. 

Strauss, A. (1987). Qualitative analysis for social scientists. New York: 
Cambridge University Press. 

Strauss, A., & Corbin, J. (1998). Basics of qualitative research. Thousand 
Oaks, CA: SAGE Publieations. 

Strauss, R. R, & Sawyer, E. A. (1986). Some new evidenee on teaeher and 
student eompeteneies. Economics of Education Review, 5, 41-48. 

Texas Center for Edueational Researeh. (2000). The cost of teacher turn- 
over. Austin: Texas State Board for Edueator Certifieation. 


Fall 2006 / Volume 6, Number 2 


40 

Torres, J., Santos, J., Peck, N. L., & Cortes, L. (2004). Minority teacher 
recruitment, development, and retention. Providence, RI: Brown Univer- 
sity, The Education Alliance. (ERIC Document Reproduction Service No. 
ED484676) 

Valli, E., & Agostinelli, A. (1993). Teaching before and after professional 
preparation: The story of a high school mathematics teacher. Journal of 
Teacher Education, 44, 107-114. 

Von Seeker, C. (2002). Effects on inquiry -based teacher practice on science 
excellence and equity. Journal of Educational Research, 95, 151-160. 

Webb, P. T., Neumann, M., & Jones, E. C. (2004). Politics, school improve- 
ment, and social justice: A triadic model of teacher leadership. The Edu- 
cational Forum, 68, 254-262. 

Wilson, S. & Floden, R. E. (2003). Creating effective teachers: Concise 
Answers for Hard Questions. An Addendum to the Report “Teacher prep- 
aration research: Current knowledge, gaps, and recommendations."' Edu- 
cation Commission of the States. (ERIC Document Reproduction Service 
No. ED 476366) 

Wilson, S. M., Floden, R., & Ferrini-Mundy, J. (2001). Teacher preparation 
research: Current knowledge, gaps, and recommendations. A research 
report prepared for the U.S. Department of Education. Seattle: Center for 
the Study of Teaching and Policy, University of Washington. Retrieved 
March 2005 from http://www.ctpweb.org/ 

York-Barr, J., & Duke, K. (2004). What do we know about teacher leader- 
ship? Findings from two decades of scholarship. Review of Educational 
Research, 74, 255-316. 


Journal of Educational Research & Policy Studies 


